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SELECTIVELY REPLAYING VOICE DATA 
DURING A VOICE COMMUNICATION SESSION 



BACKGROUND OF THE INVENTION 
1. The Field of the Invention 

[01] The invention relates to selectively replaying voice data during a communication 
session. In particular, embodiments of the invention are directed to selectively replaying voice 
data during network-based instant connect communication (also known as Push to Talk ®) and 
during conventional telephone communication. 



2. The Relevant Technology 

[02] Mobile telephones are some of the most common communication devices in use today. 
As the popularity of mobile telephones and other telephony-enabled wireless devices such as 
personal digital assistants increases, the ways in which these devices are used also grows. One 
application of mobile telephone technology is to use mobile telephones as if they were two-way 
radio devices or "walkie-talkies." The ability to use mobile telephones as walkie-talkies is 
often referred to as "push-to-talk". Communication in a push-to-talk system can be one-to-one 

£j _ or one-to-many. One example of a push-to-talk system is NexteFs iDEN-based Push to Talk® 

H 1 3 o | a (also known as Direct Connect™) service. 
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£ t % 2 o ~ I 03 ! Push-to-talk systems may be implemented using standard Voice Over Internet Protocol 
M I < 8 S i (VoIP) technologies or other technologies, where voice data is sent in digital form over data 
£ networks. Such push-to-talk systems are hereinafter referred to as "network-based instant 

connect systems", and they can be deployed in various networks, including circuit-switched 
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networks and packet data networks, and may use any combination of wireless and wireline 
devices. 

[04] Network-based instant connect communication allows a sender to speak to a recipient 
without the customary procedure of dialing a telephone number and waiting for the recipient to 
answer. Network-based instant connect communication services combine the convenience of 
near-instantaneous connection between users with the range and security afforded by a 
network. Once an instant connect session is established over the network, the voice data 
transmitted from a sender is played on the recipient's device without any action on the part of 
the recipient. This is in contrast to a regular telephone call where the recipient is required to 
manually respond to a ringing telephone. 

[05] Because network-based instant connect calls are designed to mimic walkie-talkie 
communication, the communication channel is used in a half-duplex manner, meaning that 
voice data can only flow in one direction at a time. The ability to transmit voice data is often 
referred to as "having the floor". In a network-based instant connect communication, the 
sender typically sends a floor request signal to a server in the network by pressing the talk 
button on a suitably enabled wireless device. Once the floor is granted, the sender may speak 
to the recipient until the talk button is released. The recipient of the voice data who does not 

Pi 

§ ^ have the floor can merely receive the voice data and cannot take the floor until the sender 
6 1 3 g § ? relinquishes the floor. 
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5 3 §5"S o S [06] As noted above, one general feature of network-based instant connect communications 

2 1 < | S h * s ^ at ' if ^ e recipient's device is powered on and is in a mode to accept incoming calls, any 
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incoming network-based instant connect calls result in the recipient's device automatically 
outputting voice data. The recipient of an instant connect call does not typically control when 
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the instant connect call is received and there may be situations when the recipient does not 
understand or cannot clearly hear what the sender said. 

[07] The inability to understand a sender in an instant connect call can occur, for example, 
when the recipient is in a noisy environment. Construction sites, restaurants, and traffic are 
examples of environments where a recipient of an instant connect call may be unable to 
understand the sender. The inability to understand a sender can also occur when the voice data 
is incomplete. During instant connect communication, voice data is often sent over an IP 
network using a connectionless protocol that does not guarantee delivery of the packets that are 
sent. The recipient's device plays the packets that are received, but when packets are dropped 
the played voice data may be very difficult to understand, and depending on how many packets 
are dropped, may include periods of silence when the speaker cannot be heard at all. When 
voice data is not understood, the recipient may have to wait to obtain the floor and then request 
that the sender repeat himself or herself. 

[08] Additionally, a recipient who is in a noisy environment or who is preoccupied with 
another activity may not hear an incoming network-based instant connect call at all and may 
never know that a sender attempted to reach him or her. Missing an instant connect call 
altogether could have negative consequences for both personal and business related matters. 

Pi 

§ _ [09] The problem of packet loss during voice communication is not exclusive to half-duplex 
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6 o 5 g | 3i communication; indeed, the problem applies to full-duplex voice sessions in which voice data 
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5 z § " ° o can ^ e carr i e d both directions simultaneously on a single channel, such as a wireless or wireline 

3 9 < S S h telephone call. During a full-duplex call occurring over an IP network, packet loss may occur 
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resulting in the same poor user experience previously described. In this situation, while it is 
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easier for a recipient to ask the speaker to repeat him or herself, there are situations where it 
may disrupt communication or be otherwise undesirable to do so. 
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SUMMARY OF THE INVENTION 
[010] These and other limitations of conventional voice communication are overcome by 
embodiments of the invention, which are directed to buffering voice data and selectively 
replaying the buffered voice data during or after voice communication sessions. While the 
invention is particularly useful in conjunction with network-based instant connect calls, the 
invention is not limited to this communication mode and may be applied to other voice 
communication modes such as conventional, full-duplex voice communication and to voice 
communication using devices that operate using radio frequency (RF) communication 
techniques. 

[Oil] In the exemplary embodiment, wherein the sender and one or more recipients are 
engaged in a network-based instant connect call, voice data received by a recipient's device is 
both played by the recipient's device and buffered by the device in a voice data buffer. When 
the recipient depresses a replay button, the device stops playing the voice data being received 
and begins playing voice data from the buffer. As voice data is being played from the buffer, 
the device continues to buffer any additional voice data that may be received by the device. 
This ensures that the recipient is able to listen to all of the voice data that is received by the 
device even though the voice data is being selectively replayed. 

Pi 

§ _ [012] As the voice data is buffered, silences between senders are not buffered. In addition, 
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8 o 5 g § ? voice data of the recipient is not buffered. This permits the voice data of the sender(s) to be 
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5 2 1 2 o f5 stored sequentially in the buffer and the buffered voice data can therefore be replayed faster 

^9<8ou than it occurred in "real-time." It should be noted that references to "real-time" voice data refer 
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to voice data that is being received by the device during the communication session, and which 
is then buffered. The use of the term "real-time" voice data is for convenience only and should 
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not be construed to limit the scope of the invention. For the purposes herein, "real-time" voice 
data may be played on the device after some type of delay due to network conditions or other 
conditions. As a result, replaying the buffered voice data will catch up with the real-time or 
near real-time voice data being received by the device. At this point, the device typically 
reverts to playing the voice data being received while buffering the voice data at the same time. 
[013] The buffer can be accessed, for example, in time increments or in sender increments. In 
time increments, the buffer is accessed at time periods or intervals that are pre-determined. The 
recipient can access the buffer in successive increments in this manner. Another method of 
navigating forward in time can be provided in some embodiments. This may consist of a 
second button that skips ahead one phrase (to the next silence, to the first unheard audio, or to 
real-time). Skipping to real-time can also occur if the listener begins to talk, or requests the 
floor. When the buffer is accessed in sender increments, the buffer is accessed at locations 
where a particular statement of a sender begins. One of skill in the art can appreciate that the 
location where the buffer is accessed and replayed can be configured in a variety of different 
ways. 

[014] In another embodiment, the device improves a quality of the buffered voice data by 
replacing missing or dropped packets. Voice data received by a device may be missing 

O z _ packets, for example. These missing packets can be requested and when all or some of the 
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6 1 3 8 I < P^kets are received, they are inserted into the appropriate places in the buffered voice data. 
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51|So£ Thus, the buffered voice data is more complete and can be more easily understood by a 
7$ g < 8o^ recipient. 
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[015] In another embodiment, the buffered voice data may be saved to local memory on the 
device for access at a later time. In the case where the recipient is not aware that an instant 
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connect call is incoming, the device can be configured to save a specified amount of the 
buffered voice data. For example, if the recipient does not use the talk or replay button within a 
preset amount of time, the device can interpret this to mean that the recipient is otherwise 
occupied and is unable to access the incoming voice data and the buffered voice data at the 
present time. Once this determination has been made, the device can redirect the buffered 
voice data to longer term memory on the device where it can be accessed when the recipient 
again becomes available. In this manner, the recipient can know that a sender has attempted to 
reach him or her, and the recipient can listen to the sender's saved voice data to hear the nature 
of the instant connect call. 

[016] Additional features and advantages of the invention will be set forth in the description 
which follows, and in part will be obvious from the description, or may be learned by the 
practice of the invention. The features and advantages of the invention may be realized and 
obtained by means of the instruments and combinations particularly pointed out in the 
appended claims. These and other features of the invention will become more fully apparent 
from the following description and appended claims, or may be learned by the practice of the 
invention as set forth hereinafter. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[017] In order that the manner in which the advantages and features of the invention are 
obtained, a particular description of the invention will be rendered by reference to specific 
embodiments thereof which are illustrated in the appended drawings. Understanding that these 
drawings depict only typical embodiments of the invention and are not, therefore intended to be 
considered limiting of its scope, the invention will be described and explained with additional 
specificity and detail through the use of the accompanying drawings in which: 
[018] Figure 1 is a block diagram illustrating a wireless network in which the network-based 
instant connect communication systems of the invention may be practiced; 
[019] Figure 2 illustrates one embodiment of a device that both buffers voice data and plays 
voice data such that the buffered voice data can be played back by the recipient; 
[020] Figure 3 illustrates an embodiment where the buffered voice data is played back during 
an instant connect call in a manner that prevents the user from missing any voice data; and 
[021] Figure 4 illustrates an embodiment where the quality of the buffered voice data is 
improved before or during playback of the buffered voice data. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[022] Network-based instant connect communication enables users to communicate using 
wireless or wireline networks in ways that mimic and exhibit many of the advantageous 
features of walkie-talkie communication. Network-based instant connect communications or 
calls can be one-to-one calls or one-to-many calls. To place an instant connect call, a sender 
typically identifies a recipient or a group of recipients on the contact list resident on the 
sender's wireless device. The sender next pushes a talk button or otherwise causes the wireless 
device to initiate an instant connect call to the recipient. Conventional instant connect calls are 
conducted in such a way that once the session is established, the recipient's device decodes and 
reproduces the sender's voice data. 

[023] Embodiments of the invention relate to systems and methods for selectively replaying 
the received voice data. Advantageously, a recipient device replays voice data without missing 
new voice data that may be subsequently sent to the recipient's device. In other words, while 
previously received voice data is being replayed, new voice data is stored so that the recipient 
is assured of being able to listen to the new voice data. In addition, the voice data can be 
replayed in a manner that enables the recipient to catch-up with an ongoing instant connect 
communication. In one embodiment, a recipient is able to review or replay statements made by 



voice stream. If packets are missing, the server can resend them, either in response to a request 
or automatically. The voice data being received is still played, but if the buffer is accessed and 
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the voice stream listened to again, the quality may be significantly improved. Similarly, this 
process can occur over a peer-to-peer connection. For example, there may be a direct, peer-to- 
peer connection between two or more wireless devices. A receiving wireless device may 
request missing packets from a sending device; in this case a server is not participating in the 
process. In yet another embodiment, the recipient's device may determine that the recipient is 
unavailable for an instant connect call, and the buffered voice data is then automatically 
transferred to longer term memory on the device for access at a later time. 



1. Instant Connect Communication Networks 

[025] In order to describe the various methods of the invention, Figure 1 illustrates an 
example of network 100 in which the invention can be practiced. It is to be understood that the 
network of Figure 1 represents only an example of the suitable environments in which 
embodiments of the invention can be implemented, and that other network architectures, 
including wireline networks or combinations of wireless and wireline networks, are possible. 
Network 100 includes one or more wireless telephone networks that operate with network- 
based instant connect devices 102 and 104. In the illustrated example, device 102 operates 
within cellular network 200a, while device 104 operates within cellular network 200b. 

e4 

O - [026] Figure 1 illustrates base station 106 in cellular network 200a that communicates with 
network-based instant connect device 102 by transmitting and receiving radio signals 108. 

Z © < H K 

<| * I § 1 5 ^ ase stat i° ns and other base stations in network 200a operate over respective regions or 

2s<|Sh cel * s within which the radio signals 108 are sufficiently strong to provide reliable 
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communication. In cellular networks, a grid of partially overlapping cells is positioned in a 
geographic area to provide service for the network-based instant connect devices anywhere in 
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the range of the cells. Base station 106 may operate under the control of associated base station 
controllers 112, which may in turn be coupled with a packet data serving node (PDSN) 116. 
Base station 106 may also be coupled with a mobile switching center 114, which enables 
device 102 to communicate with the public switched telephone network (PSTN) 130. 
[027] In network 100 of Figure 1, network-based instant connect device 102 may acquire 
radio connectivity and IP network connectivity in a manner well known in the art. For 
example, device 102 may issue an origination request to mobile switching center 114, which 
may send the request back to BSC 1 12. BSC 1 12 may assign a traffic channel to device 102, or 
it might forward the request to PDSN 116, which works with device 102 to establish a data link 
by which voice and data is transmitted to and received from the device. Device 102 may then 
initiate and participate in network-based instant connect communication sessions with the 
assistance of a PDSN 1 16, which provides device 102 with a gateway to IP network 118. The 
voice data from device 102 is then delivered to a network-based instant connect application 
server 120, which among other functionality, may be responsible for arbitrating and managing 
floor control allocation or voice data transmission. 

[028] Alternatively, rather than floor control being arbitrated by a network element such as an 
instant connect application server, the logic to implement floor control allocation may be 
= resident on the network-based instant connect device, in which case the participating devices 

CO 

=g decide who controls the floor. In Figure 1, since the other network-based instant connect 

B 

g device 104 is located within the range of a cellular network 200b, the base station controller 

a 

3 212 and associated PDSN 210 are used to establish the communication between the devices 
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102 and 104. Network-based instant connect device 104 acquires radio connectivity and IP 
network connectivity with the assistance of the associated BSC 212 and PDSN 210 as 
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described previously. In this way, the network-based instant connect devices 102 and 104 can 
communicate with substantially any other compatible network-based instant connect devices 
that are located in the interoperating cellular networks, such as networks 200a, 200b, etc. 
[029] It should be understood that this and other arrangements and processes described herein 
are set forth for purposes of example only, and other arrangements and elements (e.g., 
machines, interfaces, functions, orders of elements, etc.) can be added or used instead and some 
elements may be omitted altogether. Further, those skilled in the art will appreciate that many 
of the elements described herein are functional entities that may be implemented as discrete 
components or in conjunction with other components, in any suitable combination and location, 
and by software, firmware and/or hardware. 

[030] Network-based instant connect calls in network 100 are designed to give the calling 
parties an experience similar to those that are associated with the use of a conventional or 
personal walkie-talkie. Network-based instant connect devices 102 and 104 have "talk 
buttons" 202 and 204, respectively. The talk buttons are used to initiate the transmission of 
voice data from the corresponding network-based instant connect devices. In general, network- 
based instant connect calls are initiated when the user selects a recipient from the contact list on 
a wireless device and presses the talk button. Conventional network-based instant connect calls 
are received as the receiving device is automatically activated and caused to decode and 
reproduce the incoming voice data without requiring the recipient to expressly accept the call 
by manually responding to a ring or other indicator of an incoming call. 
[031] Although the cellular networks 200a and 200b on which network-based instant connect 
calls are carried inherently have full-duplex capabilities, network-based instant connect calls 
are transmitted using half-duplex communication so as to mimic the walkie-talkie experience. 
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The use of half-duplex communication means that data can travel in only one direction at any 
given time. In order to indicate to the system in which direction voice data should be sent, 
network-based instant connect devices 102 and 104 may utilize a talk button or other user input 
mechanism which causes a floor request signal to be generated. The device that has the floor 
has the ability to transmit voice data, whereas the device that does not have the floor can only 
receive the data. The invention, however, can be practiced in conjunction with methods that 
enable the party without the floor to reassign the floor and initiate the transmission of voice 
data without waiting for the remote party to relinquish the floor. 

[032] These methods can be performed in existing cellular networks (e.g., networks 200a and 
200b) that have network-based instant connect capabilities as well as with existing network- 
based instant connect devices that have been adapted to perform the acts disclosed herein. 
Examples of such methods are disclosed in U.S. Patent Application Serial No. 10/652,867, filed 
August 29, 2003, entitled "Floor Control Management in Network-Based Instant Connect 
Communication," which is incorporated herein by reference. 



2. Selectively Replaying Voice Data in an Instant Connect Call 

[033] Figure 2 illustrates wireless devices that selectively replay voice data. The device 250, 

§ ^ in this example, is a sender device that initiates an instant connect call with the device 260. 

o § * 5 
w 

6 i 5 g § % The device 250 transmits voice data 252 to the device 260. During normal operation of the 
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5 * 1 3 1 B i nstant connect call, the voice data 252 is received by the device 260 and the playback module 
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g g < | g £ 266 performs the necessary operations to immediately play the voice data 252 to the recipient. 
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The devices 250, 260 can selectively replay voice data while engaged in an instant connect call. 
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One advantage of selectively replaying voice data is that the device 260 does not have to obtain 
the floor from the device 250 in order to request that the sender repeat himself or herself. 
[034] In this embodiment, the voice data 252 is also buffered in a voice data buffer 262. The 
voice data 252 is thus being played by the playback module 266 and buffered in the voice data 
buffer 262 simultaneously. The voice data buffer 262 is typically embodied as a temporary 
buffer and may only store a limited amount of voice data. For example, the voice data buffer 
262 may be configured to store 15 seconds of voice data. Once the voice data buffer is full, the 
oldest voice data is replaced with the newest voice data. One of skill in the art can appreciate 
that the size of the voice data buffer can vary considerably and that the size of the voice data 
buffer determines how much voice data can be buffered. In some embodiments, a recipient 
may be able to permanently store a portion of the voice data buffer. However, the voice data 
buffer is typically used as a temporary storage that enables a recipient of voice data to listen to 
the recent statements of the senders in the instant connect call. Thus, the voice data buffer may 
be cleared when an instant connect call terminates or within a predetermined time after the 
instant connect call ends. 

[035] The device 260 includes a replay button 264 that can be used to selectively play voice 
data from the voice data buffer 262. The replay button 264 can be implemented in a variety of 
§ _ different ways. The replay button 264, for example, may be an independent button on the 

6 g 5 g § < device 260 or may share functionality with another button on the device 260. Thus, the 
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£j t g S § g recipient can invoke different functions depending on how the replay button 264 is configured 
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7$ 1 < § © £ or pressed. 
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[036] When the recipient depresses the replay button, the playback module 266 stops playing 
the voice data 252 being received. The playback module 266 accesses the voice data buffer 
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262 and replays the buffered voice data. While the buffered voice data is being played, the 
device 260 continues to buffer additional voice data 252 that is being received such that the 
recipient does not miss any portion of the incoming voice data. Advantageously, the recipient 
does not have to wait for the sender to relinquish the floor or interrupt the sender to ask the 
sender to repeat his or her statement. In addition, because incoming voice data is being 
continuously buffered, even while a replay activity is occurring, the recipient is able to listen to 
all of the sender's voice data. 

[037] When the playback module 266 begins playing voice data from the voice data buffer 
262, the voice data buffer 262 can be accessed in different ways. For example, the voice data 
buffer 262 may be accessed at the point that corresponds to the oldest voice data. This enables 
the recipient to replay all of the buffered voice data. Alternatively, the recipient may desire to 
access the voice data in time increments or intervals. After the replay button has been 
depressed, the playback module begins playing voice data that is, for instance, five seconds old. 
By pressing the replay button a second time or by any other input, the playback module may 
access the voice data an additional 5 seconds into the past. While in a replay mode, the replay 
button 264 or another key on the device 260 may be configured to back up additional intervals 
into the buffered voice data. Each time the relevant key is pressed in the replay mode, older 

oi 

§ = voice data is accessed. The size of the voice data buffer 262 may limit how far back into a call 
6 o 5 g § 2j a recipient can go, however. In another embodiment, the voice data buffer can be accessed by 
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^i|2|g statement or by sender. This may ensure that the replayed voice data occurs from the 
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beginning of a particular sender's voice data. In this example, each statement typically 
corresponds to the voice data transmitted by a sender while that sender has the floor of the 
instant connect call. 
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[038] As previously stated, the voice data 252 is continually being buffered by the device 260. 
This ensures that the recipient is able to listen to the entire instant connect call even when in 
replay mode. In some embodiments, the voice data buffer can be increased dynamically to 
account for instances when the recipient repeatedly depresses the replay button. Alternatively, 
the voice data that can be replayed at a given instant in time decreases because newer voice 
data may be replacing the older voice data in the voice data buffer. 

[039] The embodiment illustrated in Figure 2 also has the ability to improve the buffered 
voice data as illustrated by the voice data 254. Often, voice data is transmitted over an IP 
network using User Datagram Protocol (UDP). UDP is a connection-less protocol that 
provides little error recovery. Packets are simply sent over the network with no guarantee that 
they will arrive at the destination. In this embodiment, the voice data 254 includes packets 256 
and 258. In particular, the packets 256 represent packets of the voice data 254 that arrive at the 
device 260 and the packets 258 represent dropped or lost packets from the voice data 254. 
[040] As previously stated, the playback module 266 decodes and plays the packets that it 
receives as soon as they are received. From the recipient's perspective, the voice data 254 may 
be difficult to understand because of the dropped packets 258. In this embodiment, however, 
the voice data 254 is also buffered in the voice data buffer 262. Initially, the voice data 254 

Pi 

O _ stored in the voice data buffer 262 is missing the same dropped packets 258. The buffer control 
8 2 3 8 § < 261 may recognize that packets have been dropped or are missing from the voice data 254 and 
5 i g 2 § 5 ^ us re q uest that a network server such as the instant connect application server or the PDSN, a 
g I < | o h sen dmg wireless device, or another suitable source resend either the complete voice data 254 
^ and/or the dropped packets 258. The resent data packets of voice data 254 and/or dropped 

packets 258 have a sequence number and when they are resent to the device 260, the buffer 
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control 261 can ensure that they are placed in the voice data buffer 262 in the appropriate 
location. In this manner, the buffer control 261 can improve the quality of the buffered voice 
data in this embodiment. 

[041] Thus, when the recipient first hears the voice data 254, the recipient may not be able to 
understand the voice data 254 because of the lost or dropped packets 258 and the voice data 
may be unintelligible. When the recipient depresses the replay button 264, the buffer control 
261 may have had time to request the dropped packets and include the dropped packets in the 
voice data buffer 262. As a result, the quality of the buffered voice data may be better than the 
voice data that was originally played to the recipient. If the buffer control 261 does not have 
time to replace the dropped packets, then buffered voice is replayed to the recipient as it was 
originally buffered. The buffer control 261 can continue to request missing packets even when 
the device 260 is in a replay mode. In addition to the methods for buffering the voice data 
locally and requesting the missing packets, the invention also extends to methods performed at 
a network server or an application server to buffer the packets and to respond to requests for the 
missing packets. 

[042] In one embodiment, the device 260 can delay replaying the buffered voice data until 
sufficient packets are received. In this case, however, new voice data is still being buffered to 

Pi 

§ = ensure that the recipient is able to listen to all of the voice data. Often, the device 260 can take 
8 g 5 2 § < advantage of silences in the instant connect call to improve the quality of the buffered voice 
5l|S§g data. 



| o h [043] Figure 3 illustrates a timeline of voice data and buffered voice data from a perspective 

O < 2 ° < 

of a recipient's device. Figure 3 illustrates an example where a recipient is receiving voice data 
from three different senders: A, B, and C. The voice data 300 is received at the device as 
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follows. Voice data 302 from sender A is received at the device of the recipient and is 
followed by a silence 304. Voice data 306a from sender B is then received and is followed by a 
silence 308. The silence 308 is followed by voice data 310a from sender C, a silence 312, 
voice data 314a from sender A and a silence 313. The voice data 300 thus illustrates a typical 
instant connect call that plays voice data that is received from one or more senders. The voice 
data 300 is buffered as previously described. 

[044] When the replay button is depressed or otherwise activated, the voice data buffer is 
accessed at a predetermined point. In this example, the buffered voice data 320 represents the 
voice data that is played from the recipient's device when the replay button is depressed. At 
instant 307 in the voice data 300 of the instant connect call, the recipient depresses or activates 
the replay button. The buffered voice data is accessed and played from the beginning of the 
voice data of sender B. In this example, the buffered voice data begins playing from the 
beginning of the voice data 306a from sender B. More specifically, the buffered voice data 
306b is being replayed to the recipient. Next, the buffered voice data 310b from the sender C is 
played and is followed by the buffered voice data 314b from the sender A. 
[045] In this example, the buffered voice data 320 does not include the silences that typically 
occur in a normal instant connect call. In other words, the silences that occur between senders 
O - in an instant connect call are not typically buffered. The recipient's device or buffer control 
6 1 5 8 1 < can recognize when voice data is present and when it is not present. The instant connect call is 

C 2 h w h b 
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<i * § 3 1 o e ff ective ly time compressed by eliminating the silences. This enables the recipient's device to 
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3 I < § 2 m pl a Y the buffered voice data call faster than the instant connect call occurred in real-time. In 
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this example, at instant 316, the buffered voice data 320 has caught up to the real-time voice 
data during the silence 313. Because the replay of the buffered voice data has caught up to the 
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new voice data being received, the recipient's device can revert back to playing the voice data 
being received at the recipient's device. The recipient's device continues to buffer the voice 
data as described above. 

[046] The recipient has a choice of whether the recipient wants to hear the entire 
conversation, or just what others have said. In a preferred embodiment, the recipient's voice is 
not played, thus further accelerating the replay timeline. 

[047] Figure 4 illustrates an embodiment where the buffered voice data is improved by 
replacing dropped or missing packets. The voice data 406a from sender B includes packets 410 
that are delivered over an IP network. As previously stated, voice data packets may be dropped 
during transmission and the voice data received by a device may not include all of the packets 
that were sent. This situation is illustrated in Figure 4 by the dropped packets 412. 
[048] The device of the recipient can recognize when voice data is incomplete. The device 
can then request of a network server or a peer device that the dropped packets be resent or that 
the entire segment of voice data be resent. The packets received in response to this request 
from the client are inserted in the buffered voice data at appropriate locations. Thus, the 
buffered voice data 406b from sender B typically includes at least some of the packets 422 that 
were dropped in the original transmission of voice data as illustrated by the dropped packets 
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P|3g§3 [049] When the recipient depresses the replay button at instant 407, the buffered voice data 
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5 3 g 2 B g 406b that is played from the voice data buffer of the recipient's device is more clear due to the 
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packets as the voice data is buffered, when the user depresses the replay button, or any other 
suitable time. 
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[050] As voice data is replayed from the voice data buffer, the recipient also has various 
options. The recipient, for example, can cause the buffered voice data to be replayed at a faster 
rate. While removing the silences that typically occur in instant connect calls from the buffered 
voice data ensures that the recipient will catch up to real-time, replaying the buffered voice data 
at a faster rate enables the recipient to catch the real-time instant connect call more quickly. 
Additionally, the recipient may also have the ability to simply skip back to the real-time voice 
data. 

[051] In one embodiment, the status of the selectively replayed voice data is displayed to the 
recipient via the display of the device. For instance, the display may indicate that buffered 
voice data is being played, identify the sender corresponding to the buffered voice data being 
played, indicate a rate at which the buffered voice data is being played, display when the replay 
of the buffered voice data will catch the real-time or near real-time voice data being buffered, 
and the like or any combination thereof. 

[052] The display may also indicate buttons that may be used to alter how the buffered voice 
data is replayed. For instance, one button may change the rate at which the buffered voice data 
is replayed. Another button may enable the recipient to skip to the next sender or statement in 
the buffered voice data. The display can also identify which sender is associated with the voice 
§ _ data being replayed and update this information as the sender changes. 

@ §5 g § 5j [053] Other buttons or soft keys on the recipient's device can be used for other functions 
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^ ^ | S o g related to the buffered voice data. A first button or a button tap, for example, may skip ahead 

Sg<8oH one P^ase to the next silence, stop the playback of the buffered voice data, erase the voice data 
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buffer, jump to real-time and the like. Alternatively, jumping to real-time can occur if the 
listener begins to talk, or requests the floor. A second button may save the buffered voice data 
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as a voice message on the device for future playback. In this case, the buffered voice data that 
is converted to a voice message is stored in permanent memory of the device instead of the 
voice data buffer. This enables the recipient to store, for instance, an important part of an 
instant connect call. The voice message may be represented in and accessed from a message 
Inbox on the wireless device. 

[054] In addition, an incoming network-based instant connect call can be automatically saved 
to a local memory on the recipient device if the recipient fails to respond to or participate in the 
incoming call. As noted above, if the recipient fails to actively participate in the instant 
connect call by, for example, failing to depress the talk or replay buttons, at least a portion of 
the buffered voice data is transferred to a more permanent local memory for storage. The 
stored portion of the voice data can be later accessed by the recipient so that the recipient can 
learn the nature of the missed instant connect call. Details of suitable methods of buffering 
voice data of a network-based instant connect call are found in U.S. Patent Application Serial 
No. 10/672,579, filed September 25, 2003, which is incorporated herein by reference. The 
methods of the foregoing application can be used in connection with the buffering methods 
disclosed herein to store voice data associated with a missed network-based instant connect 
call. 

Pi 

§ ^ [055] For illustrative purposes, the foregoing embodiments use the methods disclosed herein 
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GiSggSg in conjunction with network-based instant connect communication. However, the scope of the 
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5 1 g S 5 g invention is not so limited. Other embodiments provide for buffering voice data and selectively 

S S < § o h splaying voice data during conventional, full-duplex wireline and wireless telephone calls, 
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For example, the base and handset of a recipient's cordless telephone may be suitably equipped 
to begin buffering voice data when a telephone call is received. As previously described, the 
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recipient may become subject to unanticipated environmental noise or may be otherwise unable 
to properly hear the speaker. By using one or more keys on the telephone handset, the recipient 
may replay the buffered voice data rather than asking the speaker to repeat himself. The base 
of the telephone may be equipped with longer term memory in order to store buffered voice 
data for later access. Similarly, the methods of the invention may be applied to a recipient's 
mobile telephone or other telephony-enabled wireless device to buffer the voice data of a 
conventional, full-duplex, wireless voice communication. 

[056] The invention may be embodied in other specific forms without departing from its 
spirit or essential characteristics. The described embodiments are to be considered in all 
respects only as illustrative and not restrictive. The scope of the invention is, therefore, 
indicated by the appended claims rather than by the foregoing description. All changes that 
come within the meaning and range of equivalency of the claims are to be embraced within 
their scope. 




- Page 23 - 



Docket No. 15814.16 



